Semantic partitioning facilitates memory for object location through category-partition cueing.

In our lived environments, objects are often semantically organised (e.g., cookware and cutlery are placed close together in the kitchen). Across four experiments, we examined how semantic partitions (that group same-category objects in space) influenced memory for object locations. Participants learned the locations of items in a semantically partitioned display (where each partition contained objects from a single category) as well as a purely visually partitioned display (where each partition contained a scrambled assortment of objects from different categories). Semantic partitions significantly improved location memory accuracy compared to the scrambled display. However, when the correct partition was cued (highlighted) to participants during recall, performance on the semantically partitioned display was similar to the scrambled display. These results suggest that semantic partitions largely benefit memory for location by enhancing the ability to use the given category as a cue for a visually partitioned area (e.g., toys - top left). Our results demonstrate that semantically structured spaces help location memory across partitions, but not items within a partition, providing new insights into the interaction between meaning and memory.

Conjunctive encoding of exploratory intentions and spatial information in the hippocampus.

The hippocampus creates a cognitive map of the external environment by encoding spatial and self-motion-related information. However, it is unclear whether hippocampal neurons could also incorporate internal cognitive states reflecting an animal's exploratory intention, which is not driven by rewards or unexpected sensory stimuli. In this study, a subgroup of CA1 neurons was found to encode both spatial information and animals' investigatory intentions in male mice. These neurons became active before the initiation of exploration behaviors at specific locations and were nearly silent when the same fields were traversed without exploration. Interestingly, this neuronal activity could not be explained by object features, rewards, or mismatches in environmental cues. Inhibition of the lateral entorhinal cortex decreased the activity of these cells during exploration. Our findings demonstrate that hippocampal neurons may bridge external and internal signals, indicating a potential connection between spatial representation and intentional states in the construction of internal navigation systems.

Toward a theory of perspective perception in pictures.

This paper reviews projection models and their perception in realistic pictures, and proposes hypotheses for three-dimensional (3D) shape and space perception in pictures. In these hypotheses, eye fixations, and foveal vision play a central role. Many past theories and experimental studies focus solely on linear perspective. Yet, these theories fail to explain many important perceptual phenomena, including the effectiveness of nonlinear projections. Indeed, few classical paintings strictly obey linear perspective, nor do the best distortion-avoidance techniques for wide-angle computational photography. The hypotheses here employ a two-stage model for 3D human vision. When viewing a picture, the first stage perceives 3D shape for the current gaze. Each fixation has its own perspective projection, but, owing to the nature of foveal and peripheral vision, shape information is obtained primarily for a small region of the picture around the fixation. As a viewer moves their eyes, the second stage continually integrates some of the per-gaze information into an overall interpretation of a picture. The interpretation need not be geometrically stable or consistent over time. It is argued that this framework could explain many disparate pictorial phenomena, including different projection styles throughout art history and computational photography, while being consistent with the constraints of human 3D vision. The paper reviews open questions and suggests new studies to explore these hypotheses.

Task demand mediates the interaction of spatial and temporal attention.

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Position- and scale-invariant object-centered spatial localization in monkey frontoparietal cortex dynamically adapts to cognitive demand.

Egocentric encoding is a well-known property of brain areas along the dorsal pathway. Different to previous experiments, which typically only demanded egocentric spatial processing during movement preparation, we designed a task where two male rhesus monkeys memorized an on-the-object target position and then planned a reach to this position after the object re-occurred at variable location with potentially different size. We found allocentric (in addition to egocentric) encoding in the dorsal stream reach planning areas, parietal reach region and dorsal premotor cortex, which is invariant with respect to the position, and, remarkably, also the size of the object. The dynamic adjustment from predominantly allocentric encoding during visual memory to predominantly egocentric during reach planning in the same brain areas and often the same neurons, suggests that the prevailing frame of reference is less a question of brain area or processing stream, but more of the cognitive demands.

Multisensory peripersonal space: Visual looming stimuli induce stronger response facilitation to tactile than auditory and visual stimulations.

Anticipating physical contact with objects in the environment is a key component of efficient motor performance. Peripersonal neurons are thought to play a determinant role in these predictions by enhancing responses to touch when combined with visual stimuli in peripersonal space (PPS). However, recent research challenges the idea that this visuo-tactile integration contributing to the prediction of tactile events occurs strictly in PPS. We hypothesised that enhanced sensory sensitivity in a multisensory context involves not only contact anticipation but also heightened attention towards near-body visual stimuli. To test this hypothesis, Experiment 1 required participants to respond promptly to tactile (probing contact anticipation) and auditory (probing enhanced attention) stimulations presented at different moments of the trajectory of a (social and non-social) looming visual stimulus. Reduction in reaction time as compared to a unisensory baseline was observed from an egocentric distance of around 2 m (inside and outside PPS) for all multisensory conditions and types of visual stimuli. Experiment 2 tested whether these facilitation effects still occur in the absence of a multisensory context, i.e., in a visuo-visual condition. Overall, facilitation effects induced by the looming visual stimulus were comparable in the three sensory modalities outside PPS but were more pronounced for the tactile modality inside PPS (84 cm from the body as estimated by a reachability judgement task). Considered together, the results suggest that facilitation effects induced by visual looming stimuli in multimodal sensory processing rely on the combination of attentional factors and contact anticipation depending on their distance from the body.

Disengagement of attention with spatial neglect: A systematic review of behavioral and anatomical findings.

The present review examined the consequences of focal brain injury on spatial attention studied with cueing paradigms, with a particular focus on the disengagement deficit, which refers to the abnormal slowing of reactions following an ipsilesional cue. Our review supports the established notion that the disengagement deficit is a functional marker of spatial neglect and is particularly pronounced when elicited by peripheral cues. Recent research has revealed that this deficit critically depends on cues that have task-relevant characteristics or are associated with negative reinforcement. Attentional capture by task-relevant cues is contingent on damage to the right temporo-parietal junction (TPJ) and is modulated by functional connections between the TPJ and the right insular cortex. Furthermore, damage to the dorsal premotor or prefrontal cortex (dPMC/dPFC) reduces the effect of task-relevant cues. These findings support an interactive model of the disengagement deficit, involving the right TPJ, the insula, and the dPMC/dPFC. These interconnected regions play a crucial role in regulating and adapting spatial attention to changing intrinsic values of stimuli in the environment.

Modeling the Impact of Head-Body Rotations on Audio-Visual Spatial Perception for Virtual Reality Applications.

Humans perceive the world by integrating multimodal sensory feedback, including visual and auditory stimuli, which holds true in virtual reality (VR) environments. Proper synchronization of these stimuli is crucial for perceiving a coherent and immersive VR experience. In this work, we focus on the interplay between audio and vision during localization tasks involving natural head-body rotations. We explore the impact of audio-visual offsets and rotation velocities on users' directional localization acuity for various viewing modes. Using psychometric functions, we model perceptual disparities between visual and auditory cues and determine offset detection thresholds. Our findings reveal that target localization accuracy is affected by perceptual audio-visual disparities during head-body rotations, but remains consistent in the absence of stimuli-head relative motion. We then showcase the effectiveness of our approach in predicting and enhancing users' localization accuracy within realistic VR gaming applications. To provide additional support for our findings, we implement a natural VR game wherein we apply a compensatory audio-visual offset derived from our measured psychometric functions. As a result, we demonstrate a substantial improvement of up to 40% in participants' target localization accuracy. We additionally provide guidelines for content creation to ensure coherent and seamless VR experiences.

How three-dimensional sketching environments affect spatial thinking: A functional magnetic resonance imaging study of virtual reality.

Designers rely on sketching to visualize and refine their initial ideas, and virtual reality (VR) tools now facilitate sketching in immersive 3D environments. However, little research has been conducted on the differences in the visual and spatial processes involved in 3D versus 2D sketching and their effects on cognition. This study investigated potential differences in spatial and visual functions related to the use of 3D versus 2D sketching media by analyzing functional magnetic resonance imaging (fMRI) data. We recruited 20 healthy, right-handed students from the Department of Horticulture and Landscape Architecture with at least three years of experience in freehand landscape drawing. Using an Oculus Quest VR headset controller and a 12.9-inch iPad Pro with an Apple Pencil, we tested participants individually with 3D and 2D sketching, respectively. When comparing 2D and 3D sketches, our fMRI results revealed significant differences in the activation of several brain regions, including the right middle temporal gyrus, both sides of the parietal lobe, and the left middle occipital gyrus. We also compared different sketching conditions, such as lines, geometrical objects (cube), and naturalistic objects (perspective view of a tree), and found significant differences in the spatial and visual recognition of brain areas that support visual recognition, composition, and spatial perception. This finding suggests that 3D sketching environments, such as VR, may activate more visual-spatial functions during sketching compared to 2D environments. The result highlights the potential of immersive sketching environments for design-related processes and spatial thinking.

Auditory Spatial Bisection of Blind and Normally Sighted Individuals in Free Field and Virtual Acoustics.

Sound localization is an important ability in everyday life. This study investigates the influence of vision and presentation mode on auditory spatial bisection performance. Subjects were asked to identify the smaller perceived distance between three consecutive stimuli that were either presented via loudspeakers (free field) or via headphones after convolution with generic head-related impulse responses (binaural reproduction). Thirteen azimuthal sound incidence angles on a circular arc segment of ±24° at a radius of 3 m were included in three regions of space (front, rear, and laterally left). Twenty normally sighted (measured both sighted and blindfolded) and eight blind persons participated. Results showed no significant differences with respect to visual condition, but strong effects of sound direction and presentation mode. Psychometric functions were steepest in frontal space and indicated median spatial bisection thresholds of 11°-14°. Thresholds increased significantly in rear (11°-17°) and laterally left (20°-28°) space in free field. Individual pinna and torso cues, as available only in free field presentation, improved the performance of all participants compared to binaural reproduction. Especially in rear space, auditory spatial bisection thresholds were three to four times higher (i.e., poorer) using binaural reproduction than in free field. The results underline the importance of individual auditory spatial cues for spatial bisection, irrespective of access to vision, which indicates that vision may not be strictly necessary to calibrate allocentric spatial hearing.

Advantages of Persistent Cohomology in Estimating Animal Location From Grid Cell Population Activity.

Many cognitive functions are represented as cell assemblies. In the case of spatial navigation, the population activity of place cells in the hippocampus and grid cells in the entorhinal cortex represents self-location in the environment. The brain cannot directly observe self-location information in the environment. Instead, it relies on sensory information and memory to estimate self-location. Therefore, estimating low-dimensional dynamics, such as the movement trajectory of an animal exploring its environment, from only the high-dimensional neural activity is important in deciphering the information represented in the brain. Most previous studies have estimated the low-dimensional dynamics (i.e., latent variables) behind neural activity by unsupervised learning with Bayesian population decoding using artificial neural networks or gaussian processes. Recently, persistent cohomology has been used to estimate latent variables from the phase information (i.e., circular coordinates) of manifolds created by neural activity. However, the advantages of persistent cohomology over Bayesian population decoding are not well understood. We compared persistent cohomology and Bayesian population decoding in estimating the animal location from simulated and actual grid cell population activity. We found that persistent cohomology can estimate the animal location with fewer neurons than Bayesian population decoding and robustly estimate the animal location from actual noisy data.

Converting an allocentric goal into an egocentric steering signal.

Neuronal signals that are relevant for spatial navigation have been described in many species1-10. However, a circuit-level understanding of how such signals interact to guide navigational behaviour is lacking. Here we characterize a neuronal circuit in the Drosophila central complex that compares internally generated estimates of the heading and goal angles of the fly-both of which are encoded in world-centred (allocentric) coordinates-to generate a body-centred (egocentric) steering signal. Past work has suggested that the activity of EPG neurons represents the fly's moment-to-moment angular orientation, or heading angle, during navigation2,11. An animal's moment-to-moment heading angle, however, is not always aligned with its goal angle-that is, the allocentric direction in which it wishes to progress forward. We describe FC2 cells12, a second set of neurons in the Drosophila brain with activity that correlates with the fly's goal angle. Focal optogenetic activation of FC2 neurons induces flies to orient along experimenter-defined directions as they walk forward. EPG and FC2 neurons connect monosynaptically to a third neuronal class, PFL3 cells12,13. We found that individual PFL3 cells show conjunctive, spike-rate tuning to both the heading angle and the goal angle during goal-directed navigation. Informed by the anatomy and physiology of these three cell classes, we develop a model that explains how this circuit compares allocentric heading and goal angles to build an egocentric steering signal in the PFL3 output terminals. Quantitative analyses and optogenetic manipulations of PFL3 activity support the model. Finally, using a new navigational memory task, we show that flies expressing disruptors of synaptic transmission in subsets of PFL3 cells have a reduced ability to orient along arbitrary goal directions, with an effect size in quantitative accordance with the prediction of our model. The biological circuit described here reveals how two population-level allocentric signals are compared in the brain to produce an egocentric output signal that is appropriate for motor control.

A meta-analytic review of the relation between spatial anxiety and spatial skills.

Spatial skills are key predictors of achievement in science, technology, engineering, and mathematics disciplines, despite being acquired through everyday life and not formally taught in schools. Spatial skills include a diverse group of abilities broadly related to reasoning about properties of space such as distance and direction. Recently, more research has investigated the link between spatial skills and spatial anxiety, defined as a fear or apprehension felt when engaged in spatial thinking. There has yet to be a meta-analytic review summarizing these findings. Thus, the goal of this preregistered meta-analytic review is to provide an estimate of the size of the relation between spatial anxiety and spatial skills while considering several moderators (grade/age group, sex, spatial skills measure/subtype, spatial anxiety measure/subtype, geographical region of sample, publication type/year, and risk of bias). Analyzing 283 effect sizes accumulated from research conducted between 1994 and 2020, we found a small, negative, and statistically significant (r = -.14) correlation between spatial anxiety and spatial skills. Results showed that effect sizes including mental manipulation anxiety, scalar comparison anxiety, and navigation skill were often significantly stronger than effect sizes including measures of other subtypes. The magnitude of the relation was not significantly different in children and adults, though effect sizes tended to be weaker for younger samples (r = -.08). Our results are consistent with previous findings of a significant relation between spatial anxiety and skills, and this work bridges a gap in the existing research, lending support to future research efforts investigating spatial cognition. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Environment geometry alters subiculum boundary vector cell receptive fields in adulthood and early development.

Boundaries to movement form a specific class of landmark information used for navigation: Boundary Vector Cells (BVCs) are neurons which encode an animal's location as a vector displacement from boundaries. Here we characterise the prevalence and spatial tuning of subiculum BVCs in adult and developing male rats, and investigate the relationship between BVC spatial firing and boundary geometry. BVC directional tunings align with environment walls in squares, but are uniformly distributed in circles, demonstrating that environmental geometry alters BVC receptive fields. Inserted barriers uncover both excitatory and inhibitory components to BVC receptive fields, demonstrating that inhibitory inputs contribute to BVC field formation. During post-natal development, subiculum BVCs mature slowly, contrasting with the earlier maturation of boundary-responsive cells in upstream Entorhinal Cortex. However, Subiculum and Entorhinal BVC receptive fields are altered by boundary geometry as early as tested, suggesting this is an inherent feature of the hippocampal representation of space.

The role of vision in sensory integration models for predicting motion perception and sickness.

Users of automated vehicles will engage in other activities and take their eyes off the road, making them prone to motion sickness. To resolve this, the current paper validates models predicting sickness in response to motion and visual conditions. We validate published models of vestibular and visual sensory integration that have been used for predicting motion sickness through sensory conflict. We use naturalistic driving data and laboratory motion (and vection) paradigms, such as sinusoidal translation and rotation at different frequencies, Earth-Vertical Axis Rotation, Off-Vertical Axis Rotation, Centrifugation, Somatogravic Illusion, and Pseudo-Coriolis, to evaluate different models for both motion perception and motion sickness. We investigate the effects of visual motion perception in terms of rotational velocity (visual flow) and verticality. According to our findings, the SVCI model, a 6DOF model based on the Subjective Vertical Conflict (SVC) theory, with visual rotational velocity input is effective at estimating motion sickness. However, it does not correctly replicate motion perception in paradigms such as roll-tilt perception during centrifuge, pitch perception during somatogravic illusion, and pitch perception during pseudo-Coriolis motions. On the other hand, the Multi-Sensory Observer Model (MSOM) accurately models motion perception in all considered paradigms, but does not effectively capture the frequency sensitivity of motion sickness, and the effects of vision on sickness. For both models (SVCI and MSOM), the visual perception of rotational velocity strongly affects sickness and perception. Visual verticality perception does not (yet) contribute to sickness prediction, and contributes to perception prediction only for the somatogravic illusion. In conclusion, the SVCI model with visual rotation velocity feedback is the current preferred option to design vehicle control algorithms for motion sickness reduction, while the MSOM best predicts perception. A unified model that jointly captures perception and motion sickness remains to be developed.

The Anterior Thalamus Preferentially Drives Allocentric But Not Egocentric Orientation Tuning in Postrhinal Cortex.

Navigating a complex world requires integration of multiple spatial reference frames, including information about one's orientation in both allocentric and egocentric coordinates. Combining these two information sources can provide additional information about one's spatial location. Previous studies have demonstrated that both egocentric and allocentric spatial signals are reflected by the firing of neurons in the rat postrhinal cortex (POR), an area that may serve as a hub for integrating allocentric head direction (HD) cell information with egocentric information from center-bearing and center-distance cells. However, we have also demonstrated that POR HD cells are uniquely influenced by the visual properties and locations of visual landmarks, bringing into question whether the POR HD signal is truly allocentric as opposed to simply being a response to visual stimuli. To investigate this issue, we recorded HD cells from the POR of female rats while bilaterally inactivating the anterior thalamus (ATN), a region critical for expression of the "classic" HD signal in cortical areas. We found that ATN inactivation led to a significant decrease in both firing rate and tuning strength for POR HD cells, as well as a disruption in the encoding of allocentric location by conjunctive HD/egocentric cells. In contrast, POR egocentric cells without HD tuning were largely unaffected in a consistent manner by ATN inactivation. These results indicate that the POR HD signal originates at least partially from projections from the ATN and supports the view that the POR acts as a hub for the integration of egocentric and allocentric spatial representations.

Grid codes underlie multiple cognitive maps in the human brain.

Grid cells fire at multiple positions that organize the vertices of equilateral triangles tiling a 2D space and are well studied in rodents. The last decade witnessed rapid progress in two other research lines on grid codes-empirical studies on distributed human grid-like representations in physical and multiple non-physical spaces, and cognitive computational models addressing the function of grid cells based on principles of efficient and predictive coding. Here, we review the progress in these fields and integrate these lines into a systematic organization. We also discuss the coordinate mechanisms of grid codes in the human entorhinal cortex and medial prefrontal cortex and their role in neurological and psychiatric diseases.

Reproducible stability of verbal and spatial functions along the menstrual cycle.

Recent studies have reported brain changes in response to ovarian hormonal fluctuations along the menstrual cycle. However, it remains unclear, whether these brain changes are of an adaptive nature or whether they are linked to changes in behavior along the menstrual cycle, particularly with respect to cognitive performance. To address this knowledge gap, we report results from 3 well-powered behavioral studies with different task designs, leveraging the advantages of each design type. In all three studies we assessed whether verbal or spatial performance (i) differed between cycle phases, (ii) were related to estradiol and / or progesterone levels and (iii) were moderated by individual hormone sensitivity as estimated by premenstrual symptoms. Overall, results of all three studies point towards a null effect of menstrual cycle phase and - to a lesser extent - ovarian hormones on verbal and spatial performance and provided no evidence for a moderation of this effect by individual hormone sensitivity. We conclude that there is substantial consistency in verbal and spatial performance across the menstrual cycle, and that future studies of intra-individual variation are needed.

Ego- and Geo-Centered References: A Functional Neuroimagery Study.

INTRODUCTION: The integration of vestibular, visual, and somatosensory cues allows the perception of space through the orientation of our body and surrounding objects with respect to gravity. The main goal of this study was to identify the cortical networks recruited during the representation of body midline and the representation of verticality. METHODS: Thirty right-handed healthy participants were evaluated using fMRI. Brain networks activated during a subjective straight-ahead (SSA) task were compared to those recruited during a subjective vertical (SV) task. RESULTS: Different patterns of cortical activation were observed, with differential increases in the angular gyrus and left cerebellum posterior lobe during the SSA task, in right rolandic operculum and cerebellum anterior lobe during the SV task. DISCUSSION: The activation of these areas involved in visuo-spatial functions suggests that bodily processes of great complexity are engaged in body representation and vertical perception. Interestingly, the common brain networks involved in SSA and SV tasks were comprised of areas of vestibular projection that receive multisensory information (parieto-occipital areas) and the cerebellum, and reveal a predominance of the right cerebral and cerebellar hemispheres. The outcomes of this first fMRI study designed to unmask common and specific neural mechanisms at work in gravity- or body-referenced tasks pave a new way for the exploration of spatial cognitive impairment in patients with vestibular or cortical disorders.

The mosaic structure of the mammalian cognitive map.

The cognitive map, proposed by Tolman in the 1940s, is a hypothetical internal representation of space constructed by the brain to enable an animal to undertake flexible spatial behaviors such as navigation. The subsequent discovery of place cells in the hippocampus of rats suggested that such a map-like representation does exist, and also provided a tool with which to explore its properties. Single-neuron studies in rodents conducted in small singular spaces have suggested that the map is founded on a metric framework, preserving distances and directions in an abstract representational format. An open question is whether this metric structure pertains over extended, often complexly structured real-world space. The data reviewed here suggest that this is not the case. The emerging picture is that instead of being a single, unified construct, the map is a mosaic of fragments that are heterogeneous, variably metric, multiply scaled, and sometimes laid on top of each other. Important organizing factors within and between fragments include boundaries, context, compass direction, and gravity. The map functions not to provide a comprehensive and precise rendering of the environment but rather to support adaptive behavior, tailored to the species and situation.